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I . Introduction 

A second generation study (or studies) informed by the lessons learned 
and the proBlems identified in Follow Through is certainly needed (Hodges, 
1978). The fact that the National institute of Education (NIE) is seeking 
ways to capitalize on the past is encouraging. The need for improving 
education in general and for poor children in particular is still criti- 
cal. Hopefully, the decision that will be made is to "try harder" rather 
than "give up" (Rivlin and Timpane, 1965). 

the Follow through Plahried Variation Experiments were bold new ven- 
tures in education that addressed important problems, these studies required 
collaboration among the U.S. Office of Educatidhi state departments of edu- 
cation, local educatiori agencies ^ and educational model builders (spdhsdrs). 
A deliberate effort was made td empirically cdmpare arid cdritrast the effects 
of educational models derived from different thedretical and phildsdphical 
points-of-view. St. Pierre (Note 1) has . suggested that Folldw Through 
"serves vital functions in providing funds for curriculum research and de- 
velopment under field conditions. In this light. Follow Through has pro- 
bably come closer to being a 'reform as an experiment' (Campbell, 1969) 
and to Campbell's (Note 2) vision of the 'experimenting society' than 
any other Federal program" (page 21).. 

in initiating such bold new ventures it is not surprising that the 
original experiments suffered from defects in design and execution (Haney, 



*This paper draws extensively from previously published and unpublished 
works of the author and his colleagues in the Follow Through Model Spon- 
sor's headquarters at Georgia State .blniversity--The Parent Supported Diag- 
. nostic Approach. The development of this jDaper was supported by the . 
National Institute of Education.- 
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1977; House, Slass, McLean, & Walker, 1978; Anderson, St. Pierre, Proper, 
and Stebbins, 1978; Wisler, Burns, S Iwamotb, 1978; Hodges, 1978; Kennedy^ 
1978; Bereiter S Kurland, 1978; and St. Pierre, 1978). Kennedy (1978) 
even suggested that: 

...The Follow Through study was more likely to fail than to 
succeed, the models assessed Were cdhfduhded with their spon- 
sors ' abilities to manage multiple-site implementation, as well 
as with a variety of characteristics of communities and chil- 
dren exposed to them. The tests did not equally reflect the 
goals of all the models. During the life of the study, chil- 
dren moved, schools collapsed, and teachers came and went. The 
degree of implementation depended on unions, administrators, 
and even school boards, as much as on sponsors and teachers. 
The design flaws alone have caused the study to be labeled a 
good example of bad evaluation, (p. 10-11) 

Kennedy is, however, one official who has taken a positive view of the 
study in spite of its severe limitations. She . recognized that the study 
produced new knowledge and raised important research issues. 

Program evaluation techniques were not well 
developed in 1957-1968 when the planned variation concept was first applied 
to the Follow Through program. Measurement tools were lacking. The dri- 
giriai Follow Through staff in the Office of Education was riot selected for 
its research background sirice Fblldw fhrdugh was iriterided td be a service 
rather than research prdgram. Actidris had td be takeri swiftly and there 
was little chance td hone ideas iri the crucible df cbllegial discussion 
arid criticism. 
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The history of the Follow Through Planned Variation experiment is found 
in a variety of sources, but the most complete documentation is found in 
Haney (1977) and Vinaume and Haney (1977). That history highlights a wide 
range of problems that need to Be considered in order to plan well for future 
intervention studies. The history will not be repeated here. 

This paper focuses on two interrelated categories of questions involved 
in improving the education of low-ineome children. The first category is 
programmatic^-what and how to teach — and includes both the content and the 
strategies of instruction. In Follow Through the programmatic questions 
were to be resolved through a variety of instructibrial models. Considerable 
controversy has arisen concerning the degree to which the questions of- how 
to teach young disadvantaged children have been answered. 

The second set of questions is procedural --how best to insure imple- 
mentation of ah ihstructidhal approach. In Follow Through these questions . 
are reflected in the processes of instal 1 ing and implementing an instructional 
system using a third-party intervention strategy called sponsorship. Many 
Follow Through data and the experiences of those who pa^^ticipated show that 
ftiore questions have been generated concerning the processes of educational 
change than have been answered. 

This author assumes that there is still interest in studying the use- 
fulness^of instructional models and of sponsorship as educational improvement 
strategies either singly or in combination. Both concepts are logically 
appealing, now have a history upon which to build, and have been shown 
to be effective under appropriate circumstances. 

The paper includes a summary of what Follow Through revealed about 
instructional models (Part I); sponsorship (Part H); and end s^ by proposing 
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a set of second generation studies (Part III). 

II . Inst ructional- Models 

History. Unlike Head Start and almost by accident those charged with 
managing the Follow Through program chose to use an intervention supervised 
by persons outside the local school districts. As a result of dramatic 
cuts' in the OEO budget in December 1957 the Follow Through budget Was slashed 
from $120 milVion to $15 million (Haney, 1977). 

What started but to be a major social action program built on top of 
, Head Start was in trouble. A new identity was heeded for survival and the 
hew identity was planned variation^ a cdricepit derived from some recommen- 
dations and background information^ cdritairied in the Report of the Task 
Force on Child Development chaired by William Gorham, Assistant Secretary 
for Plaririihg arid Evaluation of the Department of Health, Education and Wel- 
fare. Jha Report had suggested that the Follow Through program be used to 
evaluate major variations in compensatory education programs in the early 
elementary grades, the Task Force suggested that: ^ 

In consultation with the Office fo Economic Opportunity, the 

Commissioner of Education should develop a plan for Follow Th'-ough. 

projects that systematically vary 
— curriculum 

--pupil -instructional staff ratio 
— racial and socio-economic mix 
— age and training of teachers and aides 
--type of parent involvement. 
At the same time, he should develop a plan of evaluation usirig 
--inultiple criteria of. sueeess (aehievement, self-esteem^ 
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arid social competerice) 
--comparable measuremehts in as man^i^ programs- as possiBle; . 
(quoted in Kaney, 1977, p. 16). 

The problems of mounting such a program from the U.S. Office of Edu- 
cation were partly resolved when Robert Egbert, the Director, and Richard 
Snyder, the Chief of Evaluation, developed the idea of sponsorship. 
Sponsors would develop and implement an instructional model as well as 
relieve the U.S. Office of Education of the likely charge that they were 
dictating local educational policy and program. "From the poirit of. 
view of administering the planned variation experiment, the idea of ^ 
model sponsors was, as Richard Elmore termed it, a stroke of genius" (as 
quoted in Haney, 1977, pages 17-18). 

in Follow Through a number of jbint-veriture proaects were begun, each 
of which included an LEA, the federal gdverrimerit^ and a model sponsor. The 
state education agericies were^ iri many instances^ less conspicuous parties 
to the program. The federal gbverrimerit delegated the content of the pro- 
gram--what was to happen to children--to the sponsors. The local education 
agericies were tbhbst these models and through the direction of the sponsor 
staff iristructibri Was to be delivered to children according to the sponsors 
iristructibnal model . • 

.. Independent Variables. The instructional models became the indepen- 
dent variables. Thus the definition, classification, and validity of the 
instructional models are important issues. These three characteristics 
have been difficult to specify with clarity and preeisibri. There were 
several problems. First, the original developers were in various stages 
of development at the time of their invitaion to participate. The ulti- 
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mate form of these models was riot to evolve for sdme time to come. From 
the beginning, therefore, the studies were hampered by incomplete treatment 
definitions. 

Second, the treatments Were^ to vary curriculum, pupil-instructional 
staff ratio, racial and socioeconomic mix, age and training of teachers 
arid aideSi arid type of parent involvement (Haney, 1977, p. 167), These 
dimerisidris did not systematically enter into the selection of model sponsors 
The lack of such requirements made a mockery of planned variation. This 
problem was magnified when no program was developed to determine the actual 
variations among models early in the experiment. 

Third, comprehensive services, parent involvement, and the delivery 
systems were supposed to Be constants but they were not. These aspects 
of programs probably varied as much as the instructional approaches but 
not necessarily in tandem with the models. Even assuming a wel 1 -designed 
experiment in all other aspects any results would be suspect due to these 
variations. But even more important, eompreherisive services Were available ' 
in all communities, but not to the cbritrol childreri, thus contaminating 
the experimental -control cdmparisdris* (a fact noted too infrequently).* 

Fourth, some models changed dramatically over the course of and as 
a result of the experimerit. Everi the mdre well developed models changed 
as the developers gained iricreasirig insight into their own theoretical 
^pdsitions as a result of the tensions created between the reality of the 



*Cbmpreherisive services were, however, responsible for the parti ci- 
patidri df mariy families Whd Wduld have chosen not to become involved ex- 
cept fdr" these benefits. 
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sites and the idealism of the models. Sponsors models and communities 
have both changed as a result of the interactions. These reciprocal in- 
fluences are real -life and desirable phenomena buc they do confuse the 
identification of the treatments. 

Fifth, most sponsors associated with more than one site will testify 
to the wide variation in the degree to which the instructional model was 
executed among sites, among buildings, and among classrooms. It has become 
equally clear that sponsors varied tremendously in their effectiveness 
in the development, translation, and enactment processes of sponsorship. 

Classjif ication. Several attempts were made to classify the variations 
among treatments. Two of these were empirical arid the remaining were post 
hoc and intuitive. Soar (Note 3) made a valuable cbhtributibn to the 
Follow Through literature as he studied the interactions in a variety of 
Follow Through classrooms. He studied the differences among Follow through 
models through classroom dbservatidris . He attempted to specify these 
differences on the: basis of classroom activities and the types of teacher 
control style. Some classrooms from among nine sponsors were studied. 
The results indicated that the classrooms of the sponsors fell into from 
two to four differentiable ranges, but that these ranges were not statis- 
tically different from one another. 

Stallings and colleagues (Note- 4) and Stallings, Kaskowitz, and col- 
leagues (Note 5) studied Follow Through classrooms through an elaborate 
observation system in each of two years. Twelve sponsors' classrooms were 
observed in 1971-1972 and seven sponsors' classrooms in 1972-1973. The 
resuUs indicated that sponsor classrooms could be differentiated from one 
another with some degreej;Ol' success. It was also discovered, however, that 
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the variables that appeared most salient in the differentiations were not 
those that nefcessarily related to the conceptual dimensions of the models, 
as was predicted. Direct instruetio. and Behavior Analysis classrobiiis 
were most frequently identified correctly, they were seldom confused with 
the classrooms of other sponsors, the classrooms of other sponsors were 
seldom identified as Direct Instruction or Behavior Analysis, and class- 
rooms that were not Direct Instruction or Behavior Analysis Were more fre- 
quently confused with one another than were Direct Instruction and Behavior 
Analysis confused with any other type of program. The most important di-; 
mension enabling an observer to differentiate was the degree of structure 
in adult-child interaction, or independence of child activity. Unfortunately, 
neither the Soar (Note 3) nor the Stallings r Note 5) studies included all 
of the models that were included in the national evaluation. Both studies 
required elaborate and costly observation schemes. Experimentors did not 
use these studies to assess the relative degree of implementation and relate 
these data to the Cohort III outcome analyses (Cohort III was the principal 
cohort used to suimarize Follow Through outcomes). These studies did not 
generate the means to clearly differentiate the operating models on dimen- 
sions that make conceptual sense. 

one important post hoc intuitive differentiaiton among models Was made 
by Stebbins, St. Pierre, Proper, Anderson, & Cerva (1977) in Volume H-A 
of the Abt Associates analyses of the Cohort III data (the most widely dis- 
cussed report of the Follow Through Planned Variation experiment). The 
distinctions made by Stebbins and colleagues were based on the Written 
descriptions of the models. After reviewing several alternative classifi- 
cations, it was, decided to classify sponsor models on the basis of their 
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goals as interpreted by Stebbins and her colleagues. In addition, this 



models. Which classification came first is not clear. Models were thus 
identified as Basic Skills, Cbgni tive-Cdhceptual , or Affective. Much 
controversy Has resulted from these classifications. House, Glass, Mc- 
Lean, and Walker (1978) have said about this process: 

As anyone familiar with innovative educational programs knows, 
some distance frequently exists between a project's stated aims 
and those it actually pursues. In describing an innovation to 
those not familiar with it, one emphasizes as many good points 
as possible and ordinarily does not say much about the priorities 
among these points. In any event, to read self-descriptions 
of program goals and make a judgement about the model type is an 
exceedingly complex matter, one where reasonable people are likely 
to disagree. Furthermore, the judgements apparently were made 
intuitively. Nowhere are any procedures or criteria specified. 
The report does not describe the individuals who read the state- 
ments of goals and objectives, their training^ the time they 
took, or the directiians given to tliem. Overall* the three-fold ^ 
classification system for Follow Through models does not meet 
ths criteria that such schemes are normally expected to meet 
in social -science research. Serious questions must be asked 
about a classification derived under such conditions, (p. 136) 
Attempts to order instructional models along meaningful continua have 
suffered from diverse and often conflicting goals and objectives, the 
various assumptions about appropriate incentives for children, equivocation 



group classified the outcome measures along the same dimensions as the 



11 



' - ^ . . 10 

in sequencing activities within a program, and the lack of clear def iriitibris^ 
of teachers' roles. Karnes (Note 6) and Dickie (1958) chose the cbhtinuUm 
of level of structure within programs as the critical variable. Differences 
in structure appear to be more obvious, more readily scaled^ and more avail- 
able for empirical study than other variables. It may riot be the most criti- 
cal variable. 

Confounded with the concept of program structure is the role of the 
teacher as it is projected in differerit models. It may be possible to 
identify a cbritiriuum bf teacher behaviors related to presentation modes , 
feedback strategies^ arid diagnostic iriteractioris quite independent of pro- 
gram structure. Scales reflectirig this continuum could be drawn from the 
various models arid applied to the analysis of classroom behavior to see if 
the models generate different teaching styles and to determine the dimen- 
sioris of model differences. Identifying what teachers are required to do 
under various models Is essential (Hodges, 1973). 

There are other classifications. KohlBerg (1968) In his review of cog- 
nitive-developmental theory briefly described the nativist-maturationists 
and the behavioristic-social learning positions. Rohwer (1970) analyzed 
in some detail the instrumental -conceptual and cumulative-learning pbsitibns 
of Jerome Bruner and Robert Sagne, respectively, Katz (1969) differeritiated 
two major approaches to education as "traditional" and "experimerital . " 
She saw the major distinction between the two approaches as differences 
in teacher Behavior with respect to: (a) who initiates the classroom ac- 
tion (teacher or child); and (b) what role the teacher plays with respect 
•'to reinforcement." Bissell (Note 7) in a more f ine-grairied analysis has 
separated approaches on the basis of: (a) general teaching strategy frorn 
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permissive to structured; and (bj major curriculum input including enrich- 
ment, ebghitive, information, ehvirdhment. She then classified 20 programs 
under these dual criteria into categories of Permissive Enrichment, Structured 
Cognitive, Structured Informational, and Struccured Environment. In addition 
to this first analysis i Bissell reviewed each program for its general ob- 
jective (development of whole child, development of learning processes, and 
teaching of learning processes), the degree of structure provided, the nature 
0^ the structure, and the specific objectives for children. 

Horowitz and Paden (1972) have suggested yet another dimension sepa- . 
rating the mDdels--how disadvantaged children are viewed with respect to the 
source of their school difficulties. They point out that some assume de- 
ficit functioning in the child. Others assume that disadvantaged children 
have suffered distortions in socialization, e.g. lack of motivation for 
achievement. Still others assume that a large repertoire of cdmpetirig 
responses ha% been learned. Each of these three assumptibris--def ici t^ 
distortion, difference--l eads to differences in the resulting educational 
model. Horowitz and Paden believe that the difference assumption is the most 
parsimonious and productive. 

Definition : Proper and St. Pierre (Note 8) preferred to refer to 
the instructional programs implemented by Follow Through sponsors as approaches 
rather than models. Their reasoning was that the concept of model implied 
a fixed system uhreflective of the dynamics of educational change. Model, 
however^ does have the connotation of a more idealized design for instruction 
and thus the current author has stuck to that concept which is, by now, a 
familiar one in the educational community. "Approach" is too soft a term 
to apply to most of the models which evolved in Follow Through. 
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y/Proper and St; Pierre (Note 8) chose a framework for assessing potential 
model sponsors based on a review of Follow Through literaturej Implemehtatibh 
literature, and Follow Through regulations. This framework identifies 
elements over which sponsors have some degree of control and includes:* 

A. Program characteristics: 

1. Eurriculum and materials; 

2. Organizational structure; 

3. Rble/behavibr; 

4. Knowledge arid uriderstaridirig; arid 

5. Specif icatidri arid evaluability of objectives. 

B. Implemeritatiori strategies: 

1. U.S.O.E. (now Department of Education), sponsor, and local edu- 
cation agency relationships; 

2. Training; and 

3. Evaluation (Proper and St. Pierre, Note 8, p. 11). 

This framework is helpful but does not go far enough. In the present . 
author's framework an instructional model niast demonstrate that it is 
capable of eliciting the support of faculty, staff, administrators, and 
parents. The model -sponsor staff must be able to show changes iri the know- 
ledge, attitudes, and skills of the teaching faculties arid staffs of the 
schools with whom they affiliate. Eempenerits of the model must be clearly 
related to what the children are supposed to learn iri the schools arid those 
objectives must be clear enough for parerits arid other ribri-educators to under- 
stand what the mbdel represerits. Mbdel spbrisbrs should not be responsible 
for child achievemerit directly--that is the Ibcal district's respo sibility. 
There shbuld be bbth a division bf labor arid a division of responsibility 
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in educational improvement projects. The following characteristics are 
a_ prdpd : 

1. An instructional model will state explicit goals and objectives 
along with the source and rationale from which these goals and objectives 
are derived. Or the instructional model will include a process by which 
such goals and objectives can be derived. The rationale will reveal the 
points-of-view on child development and ihe role of formal education held 

by the model-developer. The model developer must also explain how the goals 
and bbjectives respond to societal pressures for an achievement orientation 
Based on competitive individualism. If the model-builder focuses on other 
values then these responses are critical in giving the model face-validity. 

2. An instructional model will include techniques and strategies for 
eliciting and maintaining the wil Iful interaction of children with those 
activities designed to lead to the goals and objectives of the model. It 
is assumed that these techniques and strategies are non-coercive and non- 
punitive. 

3. An instructional model will identify the criteria which guide 
the selectibri or creation of learning activities or materials consistent 
with the basic theoretical/philosophical position of the model-developer. 
These criteria may be rules for the use of any materials or activites as 
opposed to those criteria which govern selection or development; 

4. An instructional model will indicate how the activities engaged 
in by the children lead to both proximal objectives and distal goals and 
what order is presumed to best facilitate child development.. 

5. An instructional model will specify the knowledge, attitudes ^ arid 
behaviors required of the teachers, paraprofessionals, administrators^ 
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parents, and others in its implementaiton, 

6, An instructional model will include techniques and strategies for 
eliciting and maintaining the willful interaction of the faculty, staffs 
administration, and parents in the implementation of the model, 

7. An instructional model will specify the criteria to be Used in evalu- 
ating both the process and outcomes of implemehtatibn of the model and will 
specify the evidence required to substantiate the value of the model. 

In addition to including the seven parts of the iristructibnal model 
listed above a model can be Judged on its consistency among 

a. goals arid objectives with practice i 

b. practice with assessment and evaluation; 

c. assessment arid evaluatidri with goals and objectives, 

Usirig the classifications of the variables among different models 

o 

combined with the criteria for an adequate instructional model described 
below it is possible to conceptualize the multidimensional and overlapping 
nature of programs derived from different models. Developing a set of matrices 
to adequately describe model differences is one important refinement of 
efforts needed to make meaningful comparisons within- and across instructional 
models. 

Such matrices can provide an initial format for determining the inter- 
nal consistency of programs derived from a single model. Second, these 
matrices can 5e used to isolate differences among variables within one or 
more of the basic parameters of a model. The isolatiori of differences be- 
tween programs derived from the same model will allow for the experimental 
analysis of effects of single variables on children. Arid thirds these matrices 
will help . identify major and more subtle differences among models. For 
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example, two programs derived from a maturationist viewpoint fnay differ 
bri teacher behavior espoused While holding target population, materials, 
jDrierity program objectives ^ and instructional objectives constant. The 
development of these two programs from a single model conducted by several 
teachers in each program, using the classroom as the dnit of analysis, can- 
be used to generate useful data regarding general teaching strategies in 
natural settings. ; 

Similarly, behavioristic and cognitive-developmental programs may be 
derived which differ in priority program objectives, but hold constant 
specific instructional objectives, teacher behaviors, target populatidrii 
and materials. Such programs will make it possible to gather data which 
will shed some light on differences among theoretical approaches. 

Neei. It has been assumed throughout this paper that instructional 
models are an appropriate vehicle for organizing theory ^ philosophy, and 
research into a coherent system for instruction and that the further de- 
velopment of such models will be productive in the education of children. 
Not everyone agrees so it is instructive to examine some of the presumed 
benefits' as well as the potential shdrtcdmings of model building as potential 
variables for future research. 

instructional models provide an organizing focus that enables tasks to 
be conducted more efficiently and with more conviction than might otherwise 
hold. These presumptions can be put to empirical test by comparing models 
on the degree to which each does this organizational task and does, in fact, 
make life in schools more livable (Egbert & Brisch, 1978). 

Instructidrial models can provide some consistency across classrooms,, 
grade levels^ and schddls thereby potentially reducing discontinuities 
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experienced by children. One of the more obvious disadvantages of typical 
public school practice is the disarray among teachers as to what constitutes 
good professional practice. The effect of a well -conceived instructional 
model is to bring some order out of these differences. In addition models 
provide obvious criteria to use in accountability systems; an economy associated 
with a specific focus; criteria by which new ideas and data can be judged; 
and a thoughtful professionalism often lacking in public schools. 

On the other side of the ledger the Follow Through experiences suggest 
that models can narrow the range of curriculum and limit the variety of 
teaching approaches. This can reduce the probability of selecting appro- 
priate learning opportunities for those children who require an option. 
The implementation of an instructional model does require discipline^ 
extra work, strong leadership, and continual administrative support. 

The most serious flaw in model building is that some models, give the 
impression of finality/truth even though both theory and data are not suf- 
ficient to build the ultimate iristrUctidnal model. The best strategy under 
such circumstances is to build mdre^ not fewer, models, and td do more, 
not less^ research on their implementabil ity and evaluabil i ty. 

Finally^ there may be sdme merit in the proposition that teachers have 
td build their dwri mddels of instruction. Such a proposition can Be made 
drily because there is so much ignorance concerning how to build an in- 
structidrial system that can account for all learning and devcl Dp:nental be- 
havidr* ridt because there can never be a consistent system of *'Best prac- 
tice" when adults and children are involved in the teaching-learning process. 

The present diversity of models probably represents several aspects of 
iristructidri which when combined in a conceptually sound manner will lead td 
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greater empirical effectiveness. Some current model sponsors have initiated 
efforts to combine disparate instructional philosophies (notably High/ 
Scope's Cognitive Curriculum with the University of Kansas' Behavior Analysis 
Classroom and Georgia State University's Parent Supported Diagnostic Ap- 
proach with The Adaptive Learning Program of the Learning Research and De- 
velopment Center at the University of Pittsburgh) . 

III. Sponsorship 

Background , In a recent summary of 20 years of research and evaluation 
Hodges and Smith (1980) cbhcluded^that educatidhal interventions with young 
children and their families work best near the base of the originator's 
home institution and v^here the iritervehtidn is part of a well-organized 
research effort. This is likely due to a number of factors including the 
physical presence of the principal investigaior and to the special attention 
often given to those implementing the intervention. Everyone expects changes 
to occur. 

Home and preschool intervention are more successful than intervention 
into a primary classroom. Two explanations occur: the home is a smaller, 
more flexible unit than an operating classroom, and preschool classrooms 
have been established primarily for purposes of studying them./ Intrusion 
of an intervention program into the social system of ah existing publ ic 
school classroom requires changes among many levels within the system. 

Curriculum models appear to be more comparable in effectiveness when 
implemented in tightly controlled research settings even when the origi- 
nator is not actually present. Weikart's Curriculum Dembristratibn Prdaect 
(Weikart, Epstein, Schweinhart, S Bond, 1978), Karnes Curriculum Comparison 
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study (Karnes i Hddgihs, tesda* & Kirk, 1969), and the comparison of fdar 
eurricuia by Miller and Dyer (1975) all support this hypothesis; The better 
the control over the independent variables th6 more effective the inter- 
veritibris. This is no surprise and provides support for the belief that 
intervention in the preschool years can make a difference in the short- 
term if certain basic conditions—proximity, enthusiasm, foeus--are met. 

In both Head Start Planned Variation and in the Follow Through Planned 
Variation studies the intervention rodels were implemented as additions 
to or replacements for programs that were already being conducted by local 
Head Start projects and local school districts respectively.. Control over 
the independent variables (the cdrrieulum models) Was difficult in these 
situations and the results were disappointing. In Follow Through, for exampl 
there was a preponderence of null effects, a modest number of effects in 
favor of Follow Through, and a third set of effects favoring non-Follow 
through (Stebbins, et al . , 1977). When each mdders effectiveness is 
examined closely, it is clear that the models which gave the most attention 
to bhe skills typically measured on academic achievement tests had more 
success in more cdmmuriiti:^s than did the models which directed the Bulk 
of their attention to other concerns— productive language, problem-solving, 
and decisidriHiiakirig. 

The cbriclusidri above is qualified. Each Follow Through model was 
tried both in cdrmiunities in which the model was poorly implemented and 
in other cdmmunities where implementation was more favorable. There was 
sdme^ but not consistent, evidence that low levels of implementation were 
related td less favorable results for Follow Through compared to ridn-Fdllow 
thrdugh children (Stallings, 1975). But implementation and outcome were 
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not part of the same studies used to document the effects of Follow Through. 
, Nd adequate -measure of implementation of an intervention has yet been de- 
veloped, however, although the problem has received ah increasing amdurit 

of attention (Hall, toucks, Rutherford, & Newlove, 1975), 

* _ _ 

Home intervention may be the easiest type to implement. In this au- 
thor* s experience — the home instruction compbheht was easier to implement 
than the classroom instruction cdmpohent (over 90% cooperation was achieved 
from parents during the first year of the prddect). Phyllis Levenstein's 
Mother-Ehild' Home Program is a maddr intervention research effort that has 
been implemented well in cdmmuriities away from the originator with little 
apparent loss of effect. Levenstein's model does not require that an in- 
tervention be implemented in an ongoing educational or chilri-care system 
but rather within homes where there is no systematic competing program. 

Ldhg-term effects . The Consortium oh Developmental Continuity (bazar, 
Hubbelli Murray, Rdsche, & Royce, Note 9) and the High/Scope Educational 
Research Foundation (Meikart, Bond, & McNeil, 1978; Weikart, Epstein, Schwein 
hart, t Bond, 1978; and Weber, Foster, & Weikart, 1978) provide fdllow-up 
data indicating that children Who were in experimental preschool programs 
during the 196ds were more frequently in grade for age and not as frequently 
in special education as were children from contrast groups of thdse original 
studies. 

Data from the Ypsilanti Perry Preschool Project (Weikart^ Bdhd^ & 
McNeil:, 1978) show a link between the preschool and later effects in the form 
of consistently higher achievement test scores fdr the experimental children 
throughout their school years. These data ondw that the later effects are 
riot necessarily "sleeper" effects with nd mediating link between preschool 
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intervention and later school performance. 
Wei kart reported that: 

Preliminary analyses of achievement test data obtained at eighth 
grade, nine years after the preschool intervention, indicate that 
the difference between the .experimental and control groups con- 
tinued/to increase. In eighth grade^ the experimental group 
outperformed the control group on the California Achievement. 
Test total score and on all but one subtest. The magnitude of 
the treatment effect was at least twice that found at fourth 
grade. Although achievement levels in the experimental group 
remain, in general, far below that of the national , norm (as does 
achievement for the rommunity as a whole), achievement gains by 
eighth grade would seem to be educationally as well as statisti- 
cally significant, (p. .88) 
Weikart, Bond & MdNeil (1978) note that "there is little in the early 
childhood education literature to parallel this finding of achievement 
differences not merely persisting but growing* through the fourth grade" 
:(p. 88). 

How to replicate educational models but of the context of small, 
intensive, fairly well -control led riisearch studies run on, or near, a . 
model-developers' base-of-bperatibhs and irftb the n^n-experimental world 
of local school districts in far-flung communities is still a major con- 
cern. Kennedy (1978) wbhders if the idea of replicating educational in- 
terveritidhs is nbt fbbl's gold... 

...at any unit of ahalysis--ch11d, classroom, school, or com- 
muriity--edUcatidh is a dynamic process, and one which interacts 
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with all aspects of life in the community. New treatments, when 
placed in such settings ^ cannot be expected to demonstrate the 
simple additive effects that are found in laboratory studies; 
Perhaps what is needed are studies of th6, relationships between 
education and the environment, so that those factors which in- 
fluence treatments, or which combine with treatments to influence 
butcdmess can be understood, (p. 11) 

the recent emphasis on accountability has led to an even greater de- 
mand for change in the schools and more adequate evaluation systems. Con- 
sequently the process of change has become an issue in U.S, education and 
in educational research. Additional modes of encburagirig 'jhange have been, 
tried including: demonstration projects in early childhbod-special edu- 
cation, technl'cal assistance centers, strengthening state departments 
of education, establishing accountability requirements ^ emphasizing per- 
, formance standards for faculty and admiriistratbrs * establishing educational 

laboratories and research centers, initiating the Follow Through sponsor- 
■ ship concept, the Follow Thrbugh resource centers^ and building the National 
.diffusion Network. , ' 

■ From among these efforts several general strategies for change have 

emerged including the p^^ovisibri of new knowledge for those who are sup- 
posed to have pbwer tb effect change 1n practical situations, the pro- 
visibri bf technical assistance for those who are implementing new programs, 
and the prbvisibn bf model -sponsors who have the responsibility tb fbrmu- 
late, translate^ arid enact different models'of instruction. 

Spbrisbrship and Educati onal Change . Sponsorship as an educatibrial 
change process fits several of the Educational dissemination pririciples 
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as synthesized by Raizen and Green (Note 10) and Emrick and Peterson (Note ' 
11). (a) Effective dissemination and change require that usable ihfdrmatidh 
be readily available. Sponsorship meets this requirement handily since 
one task of the sponsor is to meet the iriformatibh heeds of projects, 
(b) The information should be relevant to the User's heeds. The relatively 
long-term sporisbr-LEA relatidhship might well be based upon a continuous 
assessment of the heeds of the LEA and in many instances this was the case, 
the Ipdhsdr is ih a good position to assess local needs, (c) Problem- 
solving shduld be a continuous activity. Sponsors and LEA personnel were 
engaged in this process to a greater extent than would Be likely without 
the sponso?". The presence of an external resource makes problem-solving 
a more likely activity than it is when the LEA has no external pressure, ^ 
(d) A carefully developed plan of action research must guide the change 
process. In, Follow Through there was, in many projects, a process/formative 
evaluation system that was used to inform the curriculum, staff develbpmeht, 
and parent involvement activities, (e) The culture of the community mast 
be incorporated -into the program and the innovation must be able tb adapt 
to the loca\^ environment* For several spbnsors and their related LEAs 
this processW mutual adaptation was parambunt. Since sponsor repre- 
sentatives are\in cbmmuhities fbr significant periods of time this' principle 

can be honored thrdugh the gradual shaping df bdth parties to fit the cul- 

\ " ■ . 

tural realities bf each cbmniuhity. (f) Addptidh df new ideas occurs in 

stages and the speed of addptidn is determined by the culture of the adop- 
ters and the complexity df the ihhdvatidh. This principle was a basic part 
bf the briginal grade-by-grade' ihstallation of a Follow Through model. 
In retrospect^ tnbst spdhsdrs would suggest that the adoption process be 
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broken down into even finer steps^ e.g.j teacher and parent education, 
gradual changes .in teaching style^ planned curriculum change, and careful 
process evaluation. 

Follow through observed other dissemination and change principles less 
well. For example, sustained commitment and top level administrative sup- 
port were not consistently attained early in the projects and in some pro- 
jects such commitment never materialized. Some sponsors were less than 
willing to consider alternative strategies to the ones that they advocated. 
The same can Be said for some local projects, too. Perhaps the greatest 
breach of principle was that all stakeholders were not a part of the sponsor 
selection process or the early planning of Ideal projects. It took con- 
siderable time to build a sense of openness and trust among sponsors ^ 
local projects, and the parents. In some instances such openness arid trust 
never evolved. 

Finally, Mann's (197.8) paradox is particularly relevant to the cdricept 
of sponsorship as an educational change strategy. 

Ghange is whatever the service deliverers--sctiools and teachers- 
decide it is to be. the less self-determination Is allowed to 
these ultimate implemeritdrs of change, the less total change 
will result. Ori the other hand, the federal government has a 
respdrisibility to cause improvements in education. We expect 
the federal government to make change happen even:where local 
authorities— including teachers--may disagree. The decisions 




of local-level actors about what changes should or should not 



be implemented are legitimate decisions. But so are the deeifo'Gris 



of federal-level administrators, del i very-level . autonomy 
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vitiates or contradicts federal decisions, then how can there 
be a user-driven, federally supported system of school improve-- 
ment? How can a federally sponsored system be designed that maxi- 
mizes user self-determination? (p. 389) 

Wide variation among local -project results was found among the data^ 
The level of implementation of a mode! in a local -project depended on many 
factors, including for examples: 

1. the simplicity or complexity of the educational model, 

2. the Breadth of focus of the educational model, 

3. the organization of the model -sponsor, 

4. the effectiveness Qf the model -spbnsQr representative^ 

5. the motivation of the local school district for participating 
in the study, ; ; 

5, the degree of support from the Upper admiriistratidri of the local 
school district, - ' 

7. the local -project director arid the faculty arid staff of the spe- 
cific schools irivdlved. (especially the priricipals) , 

8. local teacher placertlerit arid reteritiori policies, 

9. local child placement and retention policies, 

lb. the demands i;laced on local school districts by state departments 
of education. 

11. the influence of teacher unions, 

12. the local school district's regular curriculum, 

; 13. the Weather and natural disasters of various kinds such as floods^ 

and 

14. many othev^s. 
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Participants in the Follow Through experiment Believe that these in- 
fluences on implementation were not random and, therefore, contributed 
much to the findings of wide „variatipn among local -projects on the dutcdme 
measures used. It is unlikely that better design of new experiments will 
be able to significantly reduce these variations and, therefore^ it is 
suggested that these differences be assumed to exist arid that measures of 
implenientation be used as covariates in child outcome analyses. 

There is much unknown about the implementation df educational programs. 
Many ideas have been tried. Several ^have been evaluated. None is a clear- 
cut winner. Obviously implementation depends dri a hdst of interacting 
variables. One problem with the cbnclusidris cdncerriihg the dissemination/ 
utilization process is that the knowledge available is derived. from syn- 
theses of the results of independent studies using different strategies. 
Nowhere a re. the several techniques df educational change compared directly 
or combined te determine the effects df multiple strategies. In addition, 
the studies reviewed by Emrick and Peterson used indices of change, d;5- 
semination, and Utilization as dependent variables and did not provide 
data on child outcomes . Retrdspective studies within existing projects 
can help provide some understanding at relatively low cost. Prospective 
Follow Through studies should provide opportunities to study child out- 
comes and implementation processes concurrently. 

Measures and Variables . -Assume that an instructional model is well- 
formulated i the developer eager to cooperate in an experiment by putting 
the model dn the line, the objectives consistent with a philosophical arid 
theoretically sound base, and the instructional requirements such that 
they can be implemented in local communities. This degree of develdpmerit 
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arid eommitment is necessary but hot sufficient. There is also. a series 
of rriariagemerit variables to be considered including: 

1. The role of the Department of Education, 

2. The role of the model developer, — "'^''7 

3. the role of the 1 ocaJ^-eonilm^^ parents 
— TRe'ToTe'^f'Tl^^ Departments of Education. 

5. The role of external evaluators. 

6. The selection of instructional models. 

7. The selection of communities and their match with models. 

8. The education of stakeholders concerning the nature of the ex- 
periment and the interrelationships to be sought among them. 

The Role of the Department of - Education 

The administrative branch of the federal government is to promulgate 
rules arid regulations in accordance witK the laws passed by Congress arid 
to see that these rules and regulations are implemerited by grantees or 
contractors. In the development of Follow Through Plariried Variation * 
especially during the early years 1968-1971 ^ project officers sat with 
sponsor and local education agericy represeritatives to negotiate the bud- 
gets for each succeed i rig year. This process Was time-consuming but pro- 
ductive. The discussibri of budget items clarified the perspectives of 
all three parties cbncerriirig what both the model sponsors and the local 
education agericy desired. In some instances the federal project officer 
arbitrated differences betweeri site and sponsor that would have been dif- 
ficult for the two to resolve without the, project officer. During this 
period there was a three-party program in operation. By most accounts 
this process was meritorious. 
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The three-party negotiating process gradually faded to a mere shadow 
of the hard negotiating that took place in those first few years. Bureau- 
cratic realities, budget limitations^ changes 1n federal office priorities, 
arid an apparent lack of leadership at the federal level led to an erosion 
of the joint three-party negotiation process. What took its place was 
cbrifusidri^ indecisions and miscommunication. 

the role of the federal government in the program continues to be 
confused. The sponsors have noted the following recent items related to • 
the federal role in administering the program (Heikart, Note 12). 

- Follow Through was lev el-funded fro m 1975-1980. allowing inflatio n 
t o erode the program. This summer and fall, (1980), Congress enacted 25% 
cuts in the program as part of its efforts to balance the federal budget 
and control inflation. (Weikart reference notes, 1980, page 2-3). 

- Follow Through' s administrative agency has introduced iriitiatives 
to reduce or phase out the program every year since 1974 . The negativism 
of middle and high-level Department of Education officials towards Follow 
Through has resulted in extreme frustrations for those officials directly 
responsible for the running of the program. The National Follow Through 
Director has been quoted as saying, "Follow Through is regarded as a success- 
ful and worthwhile program everywhere but in its own agency." Cdngressionsl 
contacts have frequently told their constituents that the resistence to the 
program has not originated in Congress^ which by-and-large favors Follow 
Through, but from the administration. Congress is reluctant to support a 
jDrbgrarri which has only moderate support from its dWri agency. At a recent 
Follow Through Conference, an aide to one Senator said that one of the biggest 
obstacles facing Follow Through is the Senate's concerns about "the intent 
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.of the Department of Educatlbri." Admihistrative confusion surrounds the. 
program and the Department of Education's failure to issue new regulations 
for Follow Through is a symptom of this confusion. (Weikart, Note 12). 

- It is estimated approximately $1 .g^4flti- lion in Fo lO^w-Through funds 
for 1980 and 81 remain Unspent and may j:^-^4u CTed to the -Treasury ; Manage- 
ment of these funds has been unclear. Late in September, all of the Follow 
through local projects received calls from their project officers informing 
theiti that they would recieve 3% supplements to their budgets resulting - 
from a surplus of $800,000 left over from the previous year. A few weeks 
later, after many lo^cal projects had committed themselves to new expendi- 
tures based on the 3% increase, the budget supplements were inexplicable 
withdrawn (Weikart, Note 12). 

- The Bepartroent of Education recently awarded a large contract to 
the Urban League-using Follow Through funds .. All uhsbl icited proposals 
from grduf5s within the program were rejected without official notice to the 
proposal authors (Weikart, Note 12). 

- The Urban League is one of two hew drgariizatidns to recentl y re cieve 
Follow Through reserch funds . Follow Through awarded $400,000 of its 1980 
budget to the National Institute of Education to design a five-year program 
of Follow Through research. It is planned that NIE will receive $2.5 
million per year for the next five years to carry out the research program. 
(Weikart, Note 12). 

As one can detect from these few examples Follow Through has been 
vulnerable. The program has been subjected to repeated attempts to phase- 
buts and budget cuts, mostly initiated from within its managing agency 
(fbrmerly USOE, now Department of Education). Despite Follow Through's 
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chronic torubles with its administrative agency Congress continues, year 
after year, to appropriate money for the program. Follow Through sur- 
vives because, like Head Start, the people to whom the program is directed— 
the children, parents, teachers, staff, and community members— see it as 
successful and effective. (Weikart, Rote 12). 

One continues to hear from Department of Education officials that 
Follow Through is too expensive compared to other compensatory education 
programs. The usual referent is Title I programs. Title I, however, is 
■a "pull-out" program delivering 30'-40' of service to a child each day 
with no comprehensive services. Follow THrough, in most situations, is 
a comprehensive program providing health, nutrition, and social services, 
whole day educational programs, and systematic parent involvement. It 
has also been a vehicle for research and development- Realistic cost 
cbmparisdris have not been made. 

There are a number of roles that the Department of Edticatiq^ can take 
in the promulgation of future Follow Through studies. These roles can be 
studied as part of the research program. Whatever policy the Department 
of Education takes it should be as clearly articulated as are the obaec- 
tives required of the mode! developers and the local school districts and 
subaected to rigorous evaluation as part of the implementatidh process. 
The Role & f the Model -i3e v^loper: Sponsor 

Sponsorship differs from other intervention strategies (Beers, Notes 
13, 14). It is not technical assistance alone. Technical assistance does 
not imply responsibility .on the part of the technical assistant. Technical 
assistance also implies that there is a finite time limit between the tech- 
nic^il assistant and the client organizaiton. Spbhsdrship assumes some 
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responsibility for the effectiveness of the program and an unspecified 
time limit. Technical assistance is usually narrowly focused while spbri- 
sdrship is broadly focused. 

Consultation and sponsorship differ in the above three ways as well 
as in the degree to which the sponsor "owns'' the program compared to the 
degree to which a consultant is free of ownership. The differences be- 
tween sponsorship as a change strategy and encouraging local education 
agency self-help through monetary incentives, making information, packages^ 
and modules available, and providing new curricular program and voluntary 
training are obvious. Sponsorship is a true interventibn--thereas ^ most 
other change strategies are not. In summary, sponsorship differs from 
other strategies at least on five variables: time^ accduritabil ity ^ breadth, 
ownership, and degree of intervention. 

Bevel opment . Sponsorship can be compared With other curriculum reform 
developments of the 1950s and early 196Qs such as the Science Curriculum 
■ Improvement Study, The University of Maryland Mathematics Project, The 
School Mathematics Study Groups The University of Illinois Committee on 
School Mathematics, the Physical Science Study Committee, the Eological 
Sciences Curriculum Study ^ arid the CHEM Study. These were all devoted 
to the developmerit of curricula in a single subject-matter area. The 
taisk was similar to but more comprehensive than that assumed by a text- 
book writer." Only modest coricern was given to how these new curricula 
were to be fit Withiri the structure of the school day and the limits 
of space arid time. Each developmental group strove for the ideal in that 
particular disciplirie. Teachers generally had to execute these curricula 
with some preservice orientation and training, but with little continuous 
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support (Hodges, Sheehan, & Barter 1979); . 

Sponsors developmental tasks were different. They were able to davelop 
a complete instructional program that encompassed a major part or the whole, 
day*. No single sbbdeet-matter was the focus of their developmental ef- 
forts, hong-term training and support for teachers were provided. The 
sponsors were developing models from developmental theory^ educational 
philosophy, or psychological principles. The curriculum refdhHers in 
science arid math had done this^ tbo^ but their. theories Were more attuned 
to the subject matter and to a model of the adult as mathematician and/or 
scieritist. Spdrisbrs were concerned with the nature of the child and the 
impact of^botffliD^ and school on the emergent adult. Sponsors were following 
up Oh Head Start which was decidedly developmental in focus (D.tta, 1976). . 

Developing a more complete primary program had several implications 
First, sponsors had to think of the classroom, the home, the school , and 
the community as a system. A proposed change in the classroom effected 
other parts of the classroom as well as other parts of the system. Adding • 
achievement tests or monitoring instruments had negative or positive re- 
percussions throughout the system depending upon the degree to which each 
part of the system had Been considered. These interrelations are well 
noted by Broriferibrenner (1974) and others whose concern is with the ecology 
of educational (and other) interventions. 

Second, the system did not stop at the boundaries established by the 
legislation. The kindergarten and primary grades were only a sub-system 



*There are several execptjons to this statement. A few sponsors worked 
main1y_with parents and supplemented the routine curriculai others were 
not curriculum models^. and still others intended to supplant only the 
existing approaches, to math^ reading ^ and language. 
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of the larger network of the community. School buildings usually hosted 
three or more grades in addition to the Follow Through project. Teaching 
methods introduced as part of Follow Through spread to other classrooms, 
in some buildings not all the kindergartens or primary classes were in- 
cluded in Follow Through. In many situations there were competing programs 
in operation. Families had preschool and older children who became part 
of the system. The regulations prohibited direct services to these children 
but the concern with change dictated that sponsors deal with entire fami- 
lies. School building principals were responsible for more than Follow 
Through and this distracted from the saliency of the model. 

Third, sponsors had to consider daily classroom management concerns 
such as lunch money, bus schedules, toilet time^ play routines, state re- 
quirements for so many minutes of arithmetic or reading per day or week, 
and on ad infinitum. These concerns were met by developing curriculum 
materials, assessment procedures^ monitoring devices, training manuals, 
training workshops, training materials, and evaluation instruments and pro- 
cedures on a large scale (Rath* O'Neil, Gedney, and Osorio, 1976). A 
sponsor had to develop an instructional model for adults in addition to the 
instructidrial model for children. 

trarislatidri . Developmental activities represented the first step in 
the process of sponsorsliip the theoretical-philosophical position of the 
spdrisdr ihtb a system for educational change and dissemination. The model 
had td be translated for and by its users. 

Sdme spdnsdrs believed that presenting a set of teaching principles 
derived from cognitive theory to teachers would result in change in the 
classroom. Others believed that philosophy could be made operational by 
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continuous consulting with teachers in order to find and meet the teachers' 
needs. Still others believed that workshops on behavior management would 
be required Before discipline and on-task behavior could be improved. 
But these processes were insufficient. 

Follow Through had a research and development focus. Process evalu- 
ation was an integral part of many sponsor's implementation package. 
Sponsors learned quickly that lecture-workshops were not sufficient. 
The gap between practice and the teacher-trainer's model of teaching was 
noted. Sponsors who espoused diagnostic teaching learned that such a goal 
was riot Universally sought by teachers. Those who were interested in shifting 
from large-to small -group instruction often found a lack of enthusiasm 
for the extra work required to support it; even when extra time and pay 
were provided for planriing. Specific step-by-step instructional activities; 
. had to be developed and implemented. Rationales for all changes had to satisfy 
the natural pessimism of local staff. Frequerit (weekly if possible) mutual 
sharing and support sessions amdng local staff were necessary. 

Enactment . A third aspect of sporisdrship was to see that the users 
in a local project were able to enact the sponsor's trarislatibn of the 
model. The responsibility for getting someone else to eriact ari operational 
version was a new role. Most previous educational reforms^ such as the 
curriculum reforms in math and the sciences of the 1950s arid 19605* did 
not hold the developers responsible for implemeritirig their curricula. 
Textbook series authors are not directly responsible if their methods* 
materials, and content do not work, but sponsors were. This accountability 
resulted in heavy involvement of sponsiors in field testing and enacting the 
model; 
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The enactment process required that sponsor staff Work iri project 
communities on a periodic but routine basis. Sponsor arid cdmmUriity were 
bound together by a common funding source arid the tie between a comnunity 
and its sponsor was not easy to break. 

In order to trarislate and enact their models iri a local school system 
sponsor staffs had to be trairied iri the philbsopny arid activities of the 
model. New roles had to be developed for spdrisor-staff who visit local 
commtiriitles. Target persbririel iri local schools had to be identified. 
Sometimes a local person Was hired by the sponsor, to. be the local staff 
trairier. Iri other iristarices roles were developed wihin the local staff 
that served the training and monitoring function. Frequent visits to the 
local cornmunities by sponsor representatives were part of the routine 
pattern of service. 

The focus of development had to shift from materials to people be- 
cause Follow Through rapidly Became a major teacher-trainirig program with 
sponsor staffs analogous to departments of teacher-trainirig. Each departmerit 
(model headquarters) had its theoretical base. Each had its chairpersdri 
in the sponsor-leader, and each had one or more staff develbpmerit projects 
in local communities. 

Sponsors became on-the-job adult educators, who still had to consult 
and advocate, but who could no longer ignore the problems of meshing an 
idealized program into the real world of schools arid cbmmUriities. 

Sponsors were described by some local persbririel as catalysts. They 
provided the necessary difference to eriable the system to develop alternatives 
for some of its children. Spbrisbrs Were described as ''burs under the saddle" 
in other communities. They were seeri as iritellectual brokers— translating 
some textbook ideals of teachirig arid school irig iritb potentially usable form. 
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dne conclusion has emerged--Tbcal school districts are not usually able 
to fill the catalytic, challenging, translating functions filled by cdrnpe- 
tent sponsors. Sponsorship came to be wiewed by many as a new strategy 
of edbeatibrial dissemiriatibri, diffusion, and change, 
% Comments . Sponsorship is a critical and unique feature of Follow 
Through. It is also the most controversial. On the surface, sponsorship 
represents one of the most extreme forms of intervention. It encompasses 
other forms »bf change strategy arid adds to them by connecting schools di- 
rectly to ari immediate source for up-to-date social science research, re- 
sources for self-reriewal , and growth potential through the catalytic func- 
tion of the spdrisor. 

If sporisorship is so grand why didn't mere happen? Why are the data 
so equivocal? There are several possible explanations: 

1. Sponsorship is too extreme as it presently exists, bocal education 
agencies have too little say about the content of "the instructional pro- 
gram, too many conflicts with local and state mandates occur, tbb many 
federal programs compete for the teachers* attention and the children's 
minds. 

2. On a slightly different tack it may be that nbt enough is yet 
known about the processes involved in sponsorship so that implementatidri 
is generally weak at each link in the interactive chain among. Vocal edu- 
cation agency, sponsor, and federal agency. 

3. The models of instructibn, based as they are on child development, 
learning theory and research as well as educatibrial philosophies and con- 
ventional wisdom, reflect the weaknesses and softness in their underlying 
theories, philbsbphies, and research data. Theories are weak and convincing 
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data are scarce. Instructional technology is insufficient once instruc- 
tional objectives move past the level of basic skills. 

4. It is possible that the model developers Were not bold enough. 
What was thought to be revolutionary^iri model develdpimerit may only have been 
the reorganization of strategies similar to standard teaching practice. 
If it was otherwise one must assume that the schools selected for Follow 
Through were the least competently staffed* most disorganized, and least 
effective of all potential experimental sites and, therefore, with respect 
to their teaching, that these staffs could only improve under the auspices 
of a sponsor. If ^ on? assumes, howe^ver, that school districts were selected 
because they were among the most progressive (or aggressive) districts 
in each particular state then a different phenomenon may have been oc- 
curring. Imagine faculties who believed that they were doing a respectable 
^jbb--and the best that could be done:— who were how subject to a new or 
different model being imposed by persons external to the system. 
. ■ , 5. It is also possible that the constraints within Which public 

schools operate allow too little flexibility to aecbuimodate the dramatic 

changes necessary to show up in achievement test scores. 

^ 

The Ral ^ of the Loca l- Community 

The local education agency's mission is to deliver a prograni in accor- 
dance with local and state mandates and always Within bounds of limited 
resources. These mandates have become increasingly specific in the past 
ten years. Several states have passed minimum competency exams for gradu- 
ation from high school. The requirement of these exams has influenced 
policy, curriculum, and evaluation all the way from kindergarten through 
the twelfth grade. Reading and math management programs, minimal require- 

.38 

ERIC 



37 



ments for passage from one grade level to the nexti and; in general; more 
concrete ways oi" hold^'ng teachers accountable for child performance are 
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waxing. In at least or^e instance a local school district has decided to 
withdraw from Follow Through because it perceived the model sponsor's 
approach as not being directly relevant to the demands being placed upon 
it for achievement in reading and math. 

Local education agencies are complex social systems. These systems 
are relatively autonomous artd self-perpetuating bureaucracies With a cul- 
ture of their own. Fol^w Through required parent involvement in ways 
that local education agenciesW unprepared to accdnmiodate. Sarasdri 
(1971) has suggested "that m^y of those who comprise the school culture 
do not seek change or react enthusiastically to it." ( p. 8) Sarason 
goes ciri to suggest: V 

...that those who are respd'ns'ible for introducing change into 

i 

the school culture tend to have no clear conception of the com- 
plexity of the process--nq^drgcrhized set of principles that 

_ / _ 

explicitly takes account of ithe complexity of the setting in 

_ _/'__ ___ _ _ 

its social psychological and sociological aspects; its usual 

ways of functioning and changing; and its verbalized and unverb- 

alized traditions and values." (p. 9) 

Skinner (1968) has suggested that although the purpose of educational 

intervention is rnainly to change: 

...the behavior of the student, there are other figures in the 
world of education to which an experimental analysis applies. 
We need a better understanding not only of those who learn but 
of those (1) who teach, (2) who engage in educational research 
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immediately among Idcal-prddectSi local school districts, model -sponsors, 
arid. state edUcatidrial agencies in the present network. These studies can 
explore some of the questions concerning community difi^erences and imple- 
mentation. These initial studies can use interviews, observations, and 
documentation of various perceptions of the local environments and the pro- 
blems of implementation. Mods (1979) has pioneered in the evaluation of 
treatment environments and he and his colleagues have developed instru- 
ments for assessing the contexts within which intervention must take place. 
Adaptation of these instruments to the, primary schools can yield valuable 
data, and a framework for interpretation that was lacking in earlier studies. 

There is sufficient teacher turnover within existing local-proj6cts 
to make possible studies of different modes of staff development as new 
personnel enter the systems. Using classrooms in several communities it 
would be possible to study different ways of working with different sets 
of teachers. Superintendents, school board members, principals, teachers ^ 
arid other former participants can be interviewed to collect their percep- 
tibris about why Follow Through was diffi-Ult or easy to implemerit in a 
particular cdmmuriity. Spdrisdrs arid cdmmuriities cari study hdW td cut per- 
child costs i hdW td direct cdmmUriity cdmpreherisi ve resources td the right 
childreri withdut havirig td duplicate or pay for these resources in Follow 
Through prddectSi arid hdw td help the cdmmuriity participate more fully 
iri educatidri. 

Secdrid Gerieratidn Studies . The second generation studies proposed 
herein are addressed td a series of relevant questions. First, does more 
change in instrjction occur under a sponsored mode of educational dissemi- 
nation or under a knowledge-only mode?. Second, what are the effects of 
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an instructional system (a mode!) on child performance? Third what are 
the differential effects of different instructional systems (models) on 
child performance? These questions are not precise nor is the multi- 
purpose design for a series of suggested second-gerieratidri studies fully 
planned. These ideas are presented for discussibri purposes. 

The proposed design follows (see Figure 1): 1- Assume that six edu- 
cational models are going to be compared and that each model is to be im- 
plemented in ten communities. Communities that are asked to participate 
will have at least three school buildings which have significant numbers 
of Follow Through eligible children and whose staffs are relatively stable 
and Willing to participate in a new adventure in self -development (and 
hard-work). lil each contmunity one school buildinq will be assigned at 
random to one. models a second building to another model , and the third 
building to model X (the comparison school). In eommunity I, model A, B, 
arid X will each be assigned at random to one of the three school buildings. 
Iri Community II, mbdel A, C, and X wi11 be assigned in the same way. Iri 
Community IIU model^A, D, and X will be assigned. In Community IV^ models 
Aj E, and X will be assigned. And in Cormiunity V, models A, F^ arid X 

will be assigned. This same process will be repeated for CbmmUriities VI 

. . _ . . <t . _ . _■ . . ... . . 

through XV, thus pairing eacH model with each of the other five models. 

Beginning with community XVI and continuing through commuriity XXX the 

entire process is repeated tjntil every model has beeri paired with every 

• _ _ . _ . n; . . _ . ... . 

Other mode! twice (once in each of two communities). The pairs of models 
are assigned at random to pairs of cbmrtiuni t^^. Communities are paired 
because of their regional and demographic similarities. As can be seen in 
figure 1 models A and B were rariddmly assigned to thV^air of communities 



I and XVI. Random assignment can be achieved in three instances within 
the proposed design—when models are assigned to communities, when models 
are assigned to school s^ when communities are-assigned to the sponsorship 
or the knowledge-only change strategy. 
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Figure K _A_M'j1t1p1e-Eva1uat1on Design for Future Follow Through Studies 
Using Six Mode1s>_Th1rty Communities, Ninety School Buildings.^. Paired 
Modelsare assigned to paired conmunltles at random. Within the two com- 
munities to which a pair of models Is assigned at random the models are. . 
assigned to schools at random^ e.g. Model A Is paired with Model Bandare 
assigned to ccjitiiiunltles I S XVI at random. Then Model s_A4 B4-and X_are 
randomly assigned to schools; ConfhunltlfiS are paired Jn.ocder to be as 
danographlcally s1m11ar-a5-posslb1e.__In a palc of.coomunities one Is as- 
signed to the Sponsorship or Knowledge-only strategy at random. 

KEY: Models « A, B. C, D, E, F, X j-the non-sponsored contrast school 
^ selected , in each, cbfrinuhlty) 

p Conwunitles - l' - XXX 
Schools ■1-90 . 
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It is now possible to cofnpare fnodels with each other within the same 
conSunities in addition to' being able to compare each model with a noh- 
sponsored school in the same coninunity, Qne basic idea is that each com- 
munity can be considered to be a complete study within itself and each pair 
of coiSnUnities is another study. There are now two levels of randomi- 
zation — coimiunities to pairs of sponsors and school building to sponsor. 

The reason for pairing each pair of sponsors in two different com- 
mtajvi^tTes"^ porvide ah opportunity to study the effects of the models 
using the sponsorship strategy in one community arid using a knowledge- 
only strategy in the second community. The third random procedure is ac- 
complished when each one of a pair of cdmmUriities is assigned at random ' 
to be sponsored or to receive a knowledge-only treatment from the model 
developer. 

2 • Determine Model Eff ectiveness Independ^ntlj^^ The Idiogra p hic* - Mi thin- . 
Model -Studies 

the proposed design includes a series of within-model studies which 
requires the gather 'ng of baseline data on each of the schobls th&t are 
chosen for the studies during the year(s) preceeding the implementation 
of the models (see Figure 2). The Baseline data would include both imple- 
mentation data and child outcome data for a11 classes in each of the three 
schools in the kindergarten through the third grade. The fact that ample 
time is needed for the collection of these data is obvious. 

*Idiographic is used in this paper the sense of a study using a 
single model as the only case rather than in the regular meaning of a 
single-subject design. 
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Figure 2. Within-Model "Idiographic" Study 



The design also requires that data be gathered after the: sponsor- 
inputs have been removed. These data would also include implementation 
arid child outcome data based on the same variables as those gathered for 
the pre-sponsorship baseline, for the experimental period, and for the post- 
sponsorship period. The length of time during which these post-experimental 
data should be gathered is indeterminate, but should be for as long a 
follow-up period as possible. The proposal here is to study the classrooms 
and the children in the same k-3 classes as well as to i^ollow up the chil- 
dren who were in the classes during the experimental period. 

This part of the multiple-evaluation design permits a variety of perti- 
nent analyses directed at yielding information concerning several important 
questions. First, did any model in any community change the classroom 
implementation strategies from What they were before the model was in- 
stalled in the school building? To answer this question implementation 
data from the baseline period are compared with each of the years of model 
installation after the first installation year. This procedure is carried 
out for each of the 90 school buildings in the project. 

Second^ after sponsor-inputs are removed is there any change in ,the 
implementation strategies? Data from the post-sponsorship period are com- 
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pared With the data from the spbhsbrship period. 

Third, do child butcbme data change frbiti the baseline period to the 
experimental peribd? Outcbme data frdm the baseline and the experimental 
peribds are compared.. 

Fourth, do child outcbme data change after the sponsor-inputs are 
rembved? Outcbme data from the pbst-sponsorship period are compared with 
the dat:. from the sponsorship period.- 

these first four questions cannot be answered without entertaining 
the alternative hypothesis that history may have influenced the outcomes 
as much as the sponsor-inputs. The design of these sub-studies is, however, 
cleaner than previous studies. 
3. .Make Meaningful . rj odeJ-Compari sons 

A second set of questions to be answered involve cemparisbris among 
models within each com-nunity, including the Medisl X schbbl in each community 
where no specific model is implemented (see Figure 3). It is recbrrfnehded 
that regression analyses be used in making these cbmparisbns using imple- 
mentation scores for each of the schbbl s and regressing the outcome data 
of children on these implementatibn data. Since there are 30'communities 
involved in the study there will be 30 separate analyses. The 30-replica- 
tibns prbcedure is recbrnmended in the face bf the knowledge that community 
variability is great and is a sburce of nuisance variation that cannot be 
removed frbm the design. It is^ therefore, important to know how each model 
fares in cbmparisdri With each other model , given adjustments for implementation 
A series bf multivariate analyses is required, one for each community, 
that would provide an oversimplified picture of how many times each model 
Was mbre effective than other models' and the contrast schools in the total 
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Figure 4. Between Community/Between Change Strategies. 
* Implementation and Child Performance Data are used 
in Multiple Regression Analyses (15 separate analyses). 



graphic studies--9d in all--and within communities for between model com- 
parisons— 30 in all. In this instance, between community cbmparisdris 
are to be made. Implementation data are crucial to these comparisons and 
should be considered to be the first set of outcome data to be examined-- 
the dependent variable is implementation (at least for the first analyses). 
The question to be answered is whether or not one strategy-- sponsorship-- 
is more effective in getting a'^mbdel implemented than is another strategy-- 
knowledge only. There are more serious problems in analyzing these data 
because the differences between cdmrnUnities are hot accounted for and con- 
tribute to the variation in implementation arid probably to variation in 
child outcomes. The communities are paired in the initial selection pro- 
cess, however, so that pairs of communities that are going to Implement 
the same models (either by sponsorship or by Knowledge-only) are as similar 
as possible on demographic characteristics such as income of families 
feeding into the schools. 

Advantages of the Proposed Multiple Eval 4iatioo-Besign , The design 
and analyses proposed above offer several advantages over previous evalu- 
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cess, however, so that pairs of communities that are going to Implement 
the same models (either by sponsorship or by Knowledge-only) are as similar 
as possible on demographic characteristics such as income of families 
feeding into the schools. 

Advantages of the Proposed j iuiti pie EvaU iatiw-Besign . The design 
arid analyses proposed above offer several advantages over previous evalu- 

o '■ '• ■ ■ ■ ■ ' ' ■ 

ERIC 



51 ^ 

a comniunity that will be nuisance variation. Implementing two models in 
a conimuni ty^tWill pose no more serious problems than one model and with 
careful preplanning these community problems can be minimised; ; 

A third advantage is the multiple-evaluation strategy itself. One 
part of the multi pi e^^ strategy is the within-model idiographic design using 
Baseline data, treatment period data, and post-treatment data that will 
enable one to evaluate a model without reference to other models or to 
external controls. It is in this part of the design that it is recommended 
that each sponsor 5e required to design measures and gather data that will 
show the model to Best advantage. In addition, information will be provided 
on the effects of sponsor-withdrawal. These sponsor-specific data should 
be in addition to the basic data recbnrriended below for all schools involved 
in the project in all cdmmuhities. A second part of the strategy is the 
wi thih-cbmmuhi ty cdmparisdn among the two sponsored schools and the con- 
trast school Using multiple regression techniques with implementation scores 
and outcome scores included, the third part of the strategy is the between 
cdmrhuhity analyses using the two communities which are implementing the 
safTle models but using different implementation strategies-^sponsorship 
and khdwl edge-only. 

A fourth advantage is the economy of data collection. The same data 

........ . \ _•_ . . . 

are used in each of the facets of the multiple-evaluation strategy. For 

example the implementation \data are used in Both the within-community Be- 
tween-model s analyses and in the between-communi ty/Betweeh-chahge strate- 
gies analyses. The same chi^ld-outcome data are used throughout the analyses. 

A fifth advantage is that each model -sponsor will have to provide 
sponsorship to only five cdirmiunities plos-initial training and training 
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packages to five other commanities. A disadvantage is that models will be 
assigned to conrniuhities at random. Such a plan may require that twice as 
many communities as are needed in the final study should be selected, the 
models assigned, and time given to see if the communities can arid will work 
with the models assigned to them. 

0rie question is whether the gain by randomly assigning models to com- 
munities is worth the potential loss of implemehtatibri within communities 
who do not want to affiliate with certain models. 

. V. Conclusion ? 

A scheme for a second generation of Follow Through research is pro- 
posed in this paper, the scheme addresses questions concerning both how 
to instruct young children and how to get that instruction to them. An 
empirical approach has been recommended. Education is a value to which 
most of us pledge our allegiance. Some of us Believe that education is an 
experiment and that the experiment can Become more sophisticated. 
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